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COMMUNICATION SYSTEM 

BACKGROUND OF THE INVENTION 

In general, the present invention relates to a 
communication system, more particularly, relates to a 
communication system that allows the communication to be 
switched to the so-called television telephone with ease 
y during a telephone conversation dependent on the voice of 

the conversation partner. 

An ordinary telephone set only allows a voice 
telephone conversation with a partner. With a television- 
telephone set, however, the user can have a telephone 
conversation with a partner looking at an image of the 
partner. In addition, by connecting a video camera to a 
personal computer, the user can also have a telephone 
conversation with a partner through the Internet looking 
at an image of the partner as is the case with a 
television-telephone set . 

In order to have a telephone conversation with a 
partner while looking at an image of the partner by using 
a television-telephone set or to have a telephone 
conversation with a partner through the Internet looking 
at an image of the partner by connecting a video camera 
to a personal computer, however, it is necessary for the 



user to be present in a particular room/ a fixed place or 
the like where the television-telephone set or the 
personal computer is placed. That is to say, there is a 
problem that the user is not capable of having a 
telephone conversation with a partner while looking at an 
image of the partner with ease when the user is not 
present at the particular room or he is out. 

As a possible solution to the problem described 
above, that is, in order to make the television telephone 
usable at any place, the function of a portable telephone 
device which is widely used at the present time is 
extended so that the portable telephone device may be 
functioning as a television-telephone set. 

In this case, however, it is necessary to 
incorporate components such as a CCD camera, a liquid 
crystal display device and an image compressing/ 
decompressing circuit in the body of the portable 
telephone device itself. As a result, the portability 
inherent in the portable telephone device is lost 
substantially due to causes such as an increase in device 
size, an increase in device weight and a decrease in 
battery life. 

In stores selling home electrical appliances, on 
the another hand, a large number of television receivers 
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and VTRs of the integrated-camera type are displayed and 
there is adopted an exhibition technique of displaying 
images of customers visiting the stores taken by cameras 
and broadcasted television programs by the television 
receivers all the time. If the equipments for taking and 
displaying these images can be combined with the portable 
q telephone device carried by the user, to implement a 

o 

fU television-telephone set, the user is able to use a 

H. 5 

-"4 

m television-telephone set at any place by only visiting 

hi for example any of stores selling home electrical 

h* appliances which exist in a wide region without losing 

fU 

iU the portability of the potable telephone device itself. 

O 

is 
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SUMMARY OF THE INVENTION 

It is thus an object of the present invention 
addressing the problems described above to provide a 
communication apparatus having a simple configuration and 
a low cost such as a portable telephone device for use by 
the user to have the traditional voice telephone 
conversation with a partner wherein an extended function 
for implementing the function of a television-telephone 
set allowing the user to have a conversation with a 
partner looking at an image of the partner available by 
merely adding a minimum facility to the communication 
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apparatus such as a portable telephone device. 

According to an invention described in claim 1, a 
total communication system includes a first communication 
device which can communicate with another first 
communication device by using a first communication 
system and a second communication device which can 
communicate with another second communication device by 
using a second communication system, 

the first communication device comprising: 

a first communication means for communicating with 
the another first communication device by using the first 
communication system; 

a second communication means for communicating with 
the second communication device located in close 
proximity to the first communication device by using a 
third communication system; and 

a first control means for controlling the first and 
second communication means; 

the second communication device comprising: 

a third communication means for communicating with 
the another second communication device by using the 
second communication system; 

a forth communication means for communicating with 
the first communication device located in close proximity 




to the second communication device by using the third 
communication system; and 

a second control means for controlling the third 
and forth communication means; 

the first control means of the first communication 
device controlling the first and second communication 
means ; 

wherein the first communication device receives 
address information of the second communication device 
from the second communication device located in close 
proximity by using the third communication system; 

the first communication device transmits, using the 
first communication system, the address information 
received from the second communication device to the 
another first communication device communicated with the 
first communication device by using the first 
communication system; and 

the first communication device receives the address 
information of the another second communication device 
from the another first communication device by using the 
first communication system; 

According to an invention described in claim 14, a 
first communication device is employed in a total 
communication system comprising a first communication 
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device which can communicate with another first 
communication device by using a first communication 
system and the second communication device which can 
communicate with another second communication device by 
using a second communication system, the first 
communication device comprising: 

a f^rst communication means for communicating with 
the another first communication device by using the first 

SI 

m communication system; 

%~ - . 

§Tj a second communication means for communicating with 

1^ the second communication device located in close 

fy 

fy proximity to the first communication device by using a 

n 

Q third communication system; and 

a control means for controlling the first 
communication means and the second communication means to 
receive address information of the second communication 
device from the second communication device located in 
close proximity to the first communication device by 
using the third communication system, to transmit the 
address information received from the second 
communication device to the another first communication 
device communicated with the first communication device 
by using the first communication system, and to receive 
address information of the another second communication 



device from the another first communication device by 
using the first communication system. 

According to an invention described in claim 24 , a 
second communication device is employed in a total 
communication system comprising a first communication 
device which can communicate with another first 
communication device by using a first communication 
system and the second communication device which can 
communicate with another second communication device by * 
using a second communication system, the second 
communication device comprising: 

a third communication means for communicating with 
the another second communication device by using the 
second communication system; 

a forth communication means for communicating with 
the first communication device located in close proximity 
to the second communication device by using a third 
communication system; and 

a control means for controlling the forth 
communication means to transmit address information of 
the second communication device to the first 
communication device and for controlling the third 
communication means to receive address information of the 
another first communication device and address 
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information of the another second communication device 
from the another second communication device. 

According to an invention described in claim 33, a 
communication method using a total communication system 
includes a first communication device which can 
communicate with another first communication device by 
using a first communication system and a second 
communication device which can communicate with another 
second communication device by using a second 
communication system, the communication method comprising 
the steps of: 

receiving address information of the second 
communication device from the second communication device 
located in close proximity to the first communication 
device to the first communication device by using a third 
communication system; 

transmitting the address information received from 
the second communication device from the first 
communication device by using the first communication 
system to the another first communication device by using 
the first communication system; and 

receiving the address information of the second 
communication device transmitted from the another first 
communication device, by using the third communication 
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system. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a diagram showing a typical configuration 
of a communication system provided by the present 
invention; 

Fig. 2 is a block diagram showing a typical 

internal configuration of a portable telephone device 201 

used in the communication system shown in Fig. 1; 

Fig. 3 is a block diagram showing a typical 

» 

internal configuration of a terminal adapter 2 02 used in 
the communication system shown in Fig. 1; 

Fig. 4 is a block diagram showing a typical 
internal configuration of a television receiver 205 used 
in the communication system shown in Fig. 1; 

Fig. 5 is a block diagram showing a typical 
internal configuration of an authentication/accounting 
server 2 35 used in the communication system shown in Fig. 

i; 

Fig. 6 is a diagram showing a typical data 
structure of a user control table used in the 
authentication/accounting server 235 shown in Fig. 5; 

Fig. 7 is an explanatory diagram used for 
describing the operation of the communication system 




shown in Fig. 1; 

Fig. 8 is an explanatory diagram used for 
describing the operation of the communication system 
shown in Fig. 1 which is carried out when the portable 
telephone device 201 is moved; 

Fig. 9 is a diagram showing another typical 
configuration of a communication system provided by the 
present invention; 

Fig. 10 is a block diagram showing a typical 
internal configuration of a personal computer 301 used in 
the communication system shown in Fig. 9; 

Fig. 11 is a diagram showing another typical 
configuration of a communication system provided by the 
present invention; 

Fig. 12 is a diagram showing another typical 
configuration of a communication system provided by the 
present invention ; 

Fig. 13 is a diagram showing another typical 
configuration of a communication system provided by the 
present invention; and 

Fig. 14 is a diagram showing another typical 
configuration of a communication system provided by the 
present invention . 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
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The present invention will become apparent from the 
following detailed description of a preferred embodiment 
with reference to the accompanying diagrams* 

Fig.l is a diagram showing a typical configuration 
of a communication system provided by the present 
invention. In this typical configuration, a portable 
telephone device 201 is capable of communicating with a 
closest portable-telephone base station 231-1 by using an 
electric wave. The portable-telephone base station 231-1 
is connected to another portable-telephone base station 
231-2 through a portable- telephone 'line network 232. The 
portable-telephone base station 231-2 is capable of 
communicating with another potable telephone device 301 
by using an electric wave. 

In addition, the portable telephone device 201 is 
capable of communicating with an infrared-ray 
communication unit 204 of a terminal adapter 202 by using 
an infrared ray. The terminal adapter 202 is provided 
with a video camera 203 for taking an image of the user 
of the portable telephone device 201 and installing the 
image inside the terminal adapter 202. The terminal 
adapter 202 is connected to a television receiver 205 by 
an IEEE1394 high-speed serial bus 206 which is referred 
to hereafter simply as a 1394 bus. The television 
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receiver 205 is capable of displaying the image of the 
user of the portable telephone device 301 supplied 
thereto by the terminal adapter 202. 

The terminal adapter 202 is connected to another 
terminal adapter 302 through an OCN (Open Computer 
Network) 233 . Much like the terminal adapter 202, this 
terminal adapter 3 02 has an infrared-ray communication 
unit 304 and a video camera 303 and is thus capable of 
communicating with the portable telephone device 301 by 
using an infrared ray and taking an image of the user of 
the portable telephone device 301. * The terminal adapter 
302 is connected to a television receiver 305 by a 1394 
bus 306 and the television receiver 305 is capable of 
displaying the image of the user of the portable 
telephone device 201 supplied thereto by the terminal 
adapter 302. 

The OCN 233 is a new network provided by NTT 
(Nippon Telegraph and Telephone) Corporation for 
rendering, computer-communication services which started 
in the year of 1996. The computer-communication services 
provided by the OCN 233 include routing services based on 
the Internet protocol and Internet connection services. 
The services are best-effort services of a connectionless 
communication type suitable for computer communication. 
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The OCN 233 is connected to the Internet 234 which 
is also connected to an authentication/accounting server 
235. 

Fig. 2 is a block diagram showing a typical 
configuration of the portable telephone device 201. Since 
the configuration of the portable telephone device 301 is 
the same as that of the portable telephone device 201 , 
portable telephone device 3 01 is not shown in a figure. 

A CPU 11 carries out various kinds of processing by 

execution of programs stored in a ROM 12. A RAM 13 is 

» 

used for properly storing data and programs required by 
the CPU 11 in carrying out the processing. An EEPROM 14 
is used for storing information for uniquely identifying 
the owner of the portable telephone device 201 such as a 
PID (personal ID). 

An input unit 16 comprises the ten keys, a sharp 
key, an asterisk key and another keys as well as buttons 
used by the user for entering commands to request the CPU 
11 to carry out various kinds of processing. In 
particular, a television-telephone button 16A of the 
input unit 16 is operated by the user when it is desired 
to set the portable-telephone device 201 or 3 01 in a 
television-telephone mode. To put it in detail, this 
television-telephone button 16A is pressed in order to 
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utilize an extended function of the portable-telephone 
device 201 or 301 allowing the user to use the portable- 
telephone device 201 or 301, which is normally used as an 
ordinary telephone terminal , as a television-telephone 
terminal. A microphone 17 picks up voice of the user 
whereas a speaker 18 outputs voice of a communication 
partner to the user. A display unit 19 is implemented 
typically by an LCD. A number or a symbol entered by the 
user by operating a key or a message generated by the 
portable-telephone device 201 or 301 appears on the 
display unit 19. 

A radio-communication unit 2 0 carries out 
communication with the closest portable-telephone base 
station 231-1. An infrared-ray communication unit 24 
comprises a command generating/analyzing unit 21, an 
infrared-ray generating unit 22 and an infrared-ray 
receiving unit 23. The infrared-ray generating unit 22 
generates an infrared-ray signal corresponding to a 
command supplied thereto by the command 

generating/analyzing unit 21 , transmitting the signal to 
the infrared-ray communication unit 204 of the terminal 
adapter 202. The infrared-ray receiving unit 23 receives 
an infrared-ray signal transmitted thereto by the 
infrared-ray communication unit 204 of the terminal 

14 




adapter 202 , passing the signal to the command 
generating/analyzing unit 21. On the another hand, the 
command generating/analyzing unit 21 generates a command 
according to an instruction issued by the CPU 11 , 
outputting the command to the infrared-ray generating 
unit 22. In addition, the command generating/analyzing 
unit 21 analyzes a signal received from the infrared-ray 
receiving unit 23 , supplying a result of the analysis to 
the CPU 11. An interface unit 15 carries out interface 
processing between the CPU 11 and components on the 
another side, that is, the input unit 16, the microphone 
17, the speaker 18, the display unit 19, the radio- 
communication unit 20, the command generating/analyzing 
unit 21, the infrared-ray generating unit 22, the 
infrared-ray receiving unit 23 , the infrared-ray 
communication unit 24. 

Fig. 3 is a block diagram showing a typical 
configuration of the terminal adapter 202. It should be 
noted that, since the configuration of the terminal 
adapter 302 is the same as that of the adapter 202, the 
terminal adopter 3 02 is not shown in a figure. 

A CPU 31 carries out various kinds of processing by 
execution of programs stored in a ROM 32. A RAM 33 is 
used for properly storing data and programs required by 
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the CPU 31 in carrying out the processing. A 
compression/decompression circuit 34 compresses and 
decompresses video and audio data. An EEPROM 35 is used 
for storing information such as a TAID (terminal ID) of 
the terminal adapter 202. 

A communication unit 37 carries out communication 
with the OCN 233. An infrared-ray communication unit 204 
comprises a command generating/analyzing unit 38, an 
infrared-ray generating unit 3 9 and an infrared-ray 
receiving unit 40. The command generating/analyzing unit 
3 8 generates a command according to* an instruction issued 
by the CPU 31 , outputting the command to the infrared-ray 
generating unit 39. The infrared-ray generating unit 39 
generates an infrared-ray signal corresponding to a 
command supplied thereto by the command 

generating/analyzing unit 38 , transmitting the signal to 
the infrared-ray communication unit 24 of the portable- 
telephone device 201. On the another hand, the 
infrared-ray receiving unit 4 0 receives an infrared-ray 
signal transmitted thereto by the infrared-ray 
communication unit 24 of the portable-telephone device 
201, passing the signal to the command 

generating/analyzing unit 38. In addition, the command 
generating/analyzing unit 21 analyzes the signal received 
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from the infrared-ray receiving 40, supplying a result of 
the analysis to the CPU 31. 

A video-camera control unit 41 controls the video 
camera 203 to take an image of the user and outputs the 
image to the compression/decompression circuit 34. A 
1394-interf ace unit 42 carries out interface processing 
between the CPU 31 and the 1394 bus 206. An input unit 43 
is operated by the user for entering a variety of 
commands. An interface unit 3 6 carries out interface 
processing between the CPU 31 and the communication unit 
37 , the command generating/analyzing unit 38, the 
infrared-ray generating unit 39, the infrared-ray 
receiving unit 40, the video-camera control unit 41, the 
1394-interf ace unit 42 and the input unit 43. 

Fig. 4 is a block diagram showing a typical 
configuration of the television receiver 205. It should 
be noted that, since the * configuration of the television 
receiver 305 is the same as that of the television 
receiver 205, the television receiver 305 is not shown in 
a figure. 

A CPU 61 carries out various kinds of processing by 
execution of programs stored in a ROM 62. A RAM 63 is 
used for properly storing data and programs required by 
the CPU 61 in carrying out the processing. Controlled by 

17 



the CPU 61 through an interface unit 64 , a tuner 65 
receives an electric wave from a predetermined 
broadcasting station and outputs a video signal obtained 
as modulation of the electric wave to a display unit 67 
by way of a synthesizer 66. The display unit 67 is 
implemented typically by a CRT. Controlled by the CPU 61 
through the interface unit 64, a video-signal generating 
unit 68 generates a video signal and outputs the signal 
to the synthesizer 66 which synthesizes the video signal 
supplied thereto by the video-signal generating unit 68 
and a video signal output by the tuner 65, outputting the 
synthesized signal to the display unit 67. 

An audio signal output by the tuner 65 is supplied 
to a speaker 70 by way of a synthesizer 69. Controlled by 
the CPU 61 through the interface unit 64, an audio-signal 
generating unit 71 generates an audio signal and outputs 
the signal to the synthesizer 69 which synthesizes the 
audio signal supplied thereto by the audio signal 
generating unit 71 and an audio signal output by the 
tuner 65, outputting the synthesized signal to the 
speaker 70. 

A 1394-interface unit 72 carries out interface 
processing between the CPU 61 and the 1394 bus 206. 
Composed of switches, buttons or a dedicated remote 
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commander, an input unit 73 supplies a command entered by 
the user to the CPU 61 through the interface unit 64. 

Fig. 5 is a block diagram showing a typical 
configuration of the authentication/accounting server 235. 
A CPU 81 carries out various kinds of processing by 
execution of programs stored in a ROM 82. A RAM 83 is 
used for properly storing data and programs required by 
the CPU 81 in carrying out the processing. A keyboard 85 
and a mouse 86 are operated by the user for entering a 
variety of commands. On a display unit 87, characters and 
images are properly displayed. A hard disc 88 is used for 
storing a user control table as shown in Fig. 6. Each row 
of the user control table comprises pieces of information 
including the personal ID (PID) of a portable-telephone 
device such as the portable-telephone device 201 or 301 , 
the terminal ID (TAID) of a terminal adapter such as the 
terminal adapter 202 or 302, a usage start time and date 
of the television-telephone set to be described later, a 
usage end time and date of the television-telephone set 
also to be described later, a cumulated charge of using 
the television-telephone set and the number of a credit 
card to which the cumulated charge is to be billed. In 
addition, the hard disc 88 is also used for storing a 
communication history for each user in addition to the 
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information required for authentication and accounting 
processing for telephone services rendered to the user. 

A communication unit 89 carries out communication 
with the Internet 234. A microphone 90 picks up voice of 
the user and a speaker 91 outputs an audio signal to the 
user. An interface unit 84 carries out interface 
processing between the CPU 81 and the components; the 
keyboard 85 , the mouse 86, the display unit 87 , the hard 
disc 88 , the communication unit 89, the microphone 90 , 
and the speaker 91. 

Next, the operation of the communication system is 
explained referring to Fig. 7. As shown in the figure, 
the operation of the communication system begins with the 
step S101 at which the user of the portable-telephone 
device 201 operates the input unit of the portable- 
telephone device 201, entering the telephone number of 
the portable-telephone device 301 in order to call the 
portable-telephone device 301. When the telephone number 
of the portable-telephone device 301 and a command for 
starting transmission of a calling signal are entered by 
the input unit 16, the CPU 11 controls the radio- 
communication unit 20, and outputs an electric wave 
conveying the calling signal to the closest portable- 
television base station 231-1. Subsequently, the calling 
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signal is transmitted from the portable-telephone base 
station 231-1 to the portable-telephone base station 231- 
2 through the portable-telephone line network 232. Then, 
an electric wave conveying the calling signal is 
transmitted by the portable-telephone base station 231-2 
to the portable-telephone device 301. 

The radio-communication unit 2 0 employed in the 
portable-telephone device 301 receives the calling signal, 
supplying the calling signal to the CPU 11. At a step 
S501, detecting such an incoming call, the CPU 11 
controls the display unit 19 and the speaker 18. The 
display unit 19 displays characters or symbols indicating 
that a call has been received while the speaker 18 
outputs an audio signal to notify the user of the 
incoming call. Being aware of the incoming call, the user 
of the portable-telephone device 301 operates a response 
button of the input unit 16 of the portable-telephone 
device 301 at a step S502 to generate a response to the 
incoming call. 

The portable-telephone device 201 receives a 
response signal transmitted by the portable-telephone 
device 301 at a step SI 02, occupying a communication line 
between the portable-telephone devices 201 and 301. 
Thereafter, an audio signal picked up by the microphone 
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17 employed by the portable-telephone device 201 is 
supplied to the radio-communication unit 20 through the 
interface unit 15 in the portable-telephone device 2 01 
and then transmitted by the radio-communication unit 20 
along a path comprising the portable-telephone base 
station 231-1, the portable-telephone line network 232 
and the portable-telephone base station 231-2 to the 
portable-telephone device 301 wherein the audio signal is 
output to the speaker 18 through the radio-communication 
unit 20 and the interface unit 15. By the same token, an 
audio signal picked up by the microphone 17 employed by 
the portable-telephone device 301 is supplied to the 
radio-communication unit 20 through the interface unit 15 
in the portable-telephone device 301 and then transmitted 
by the radio-communication unit 20 along a path 
comprising the portable-telephone base station 231-2, the 
portable-telephone line network 232 and the portable- 
telephone base station 231-1 to the portable-telephone 
device 201 wherein the audio signal is output to the 
speaker 18 by way of the radio-communication unit 20 and 
the interface unit 15. In this way, an ordinary telephone 
conversation based on audio signals is thus possibly made 
between the users of the portable-telephone devices 201 
and 301. 
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Next, when the user of the portable-telephone 
device 2 01 wants to switch the communication mode from 
the ordinary telephone conversation based only on audio 
signals to the so-called television-telephone 
conversation accompanied by transmission of images, the 
user operates the television-telephone button 16A of the 
portable-telephone device 201 at a step S103. At that 
time, the CPU 11 employed in the portable-telephone 
device 201 reads out a personal ID (which is abbreviated 
hereafter to a PID) of the portable-telephone device 201 
from the EEPROM 14, outputting the PID to the command 
generating/analyzing unit 21 along with a request for a 
television-telephone connection. The PID and the request 
for a television-telephone connection are then 
transmitted to the terminal adapter 2 02 by the infrared- 
ray generating unit 22 by an infrared-ray signal. 

When the infrared-ray receiving unit 4 0 employed in 
the terminal adapter 202 receives the infrared-ray signal 
transmitted by the portable-telephone device 201 at a 
step S201, a command conveyed by the signal from the 
infrared-ray receiving unit 4 0 is output to the command 
generating/analyzing unit 38 which analyzes the command 
and supplies a result of the analysis to the CPU 31 
through the interface unit 36. Receiving the PID and the 
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request for a television-telephone connection transmitted 
by the portable-telephone device 201 at a step S202 , the 
CPU 31 controls the communication unit 37 through the 
interface unit 3 6 to make an access to the 
authentication/accounting server 235 through the OCN 233 
and the Internet 234. In the access, the PID of the 
portable-telephone device 201 and a terminal ID (referred 
to hereafter as a TAID) of the terminal adapter 202 read 
out from the EEPROM 3 5 are transmitted to the 
authentication/accounting server 235 along with a request 
for authentication . 

At a step S401, the authentication/accounting 
server 235 receives the request for authentication, the 
PID and the TAID transmitted by the terminal adapter 2 02 
through the communication unit 89 employed in the server 
235. The CPU 81 employed in the authentication/accounting 
server 235 judges whether or not the PID and the TAID are 
registered in the user control table of Fig. 6 stored in 
the hard disc 88 as IDs which can be authenticated, that 
is, judged to be valid IDs. If the PID and the TAID are 
registered in the user control table as valid IDs, the 
present time and date are cataloged in the user control 
table as a usage start time and date. At a step S402, the 
CPU 81 of the authentication/accounting server 235 
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transmits a result of authentication from the 
communication unit 89 to the communication unit 3 7 of the 
terminal adapter 2 02 through the Internet 234 and the OCN 
233. 

At a step S2 03, the CPU 31 of the terminal adapter 
202 evaluates the result of authentication received from 
the communication unit 37. If the result of 
authentication indicates that the PID and TAID required 
for carrying out a television-telephone communication are 
valid, the CPU 31 reads out an IP address IP (202) of the 
terminal adapter 202 stored in the EEPROM 35 in advance 
and controls the command generating/analyzing unit 38 to 
transmit the IP address IP (202) to the portable- 
telephone device 201 through the infrared-ray generating 
unit 39 as an infrared-ray signal at a step S204. 

At a step S104 the IP address IP (202) is received 
by the infrared-ray receiving unit 23 employed in the 
portable-telephone device 201 and pass the signal to the 
CPU 11 by the command generating/analyzing unit 21 by way 
of the interface unit 15. 

If the result evaluated at the step S203 indicates 
that authentication required for carrying out a 
television-telephone communication is not obtained, on 
the another hand, the IP address IP (202) of the terminal 
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adapter 202 itself is not transmitted to the portable- 
telephone device 201 at the step S204. If the CPU 11 
employed in the portable-telephone device 201 does not 
receive the IP address from the terminal adapter 2 02 at 
the step S104 the CPU 11 judges that the television- 
telephone communication is not authenticated and 
therefore does not carry out subsequent processing for 
the television-telephone communication any more. 

If the CPU 11 receives the IP address IP (202) from 
the terminal adapter 202 at the step SI 04 as described 
above, on the another hand, the CPU 11 judges that the 
television-telephone communication is properly 
authenticated and therefore enters a television-telephone 
mode to carry out subsequent processing for the 
television-telephone communication . 

In this case, at a step S105, the CPU 11 employed 
in the portable-telephone device 201 controls the radio- 
communication unit 20 to transmit the IP address IP (202) 
of the terminal adapter 202 received at the step S104 to 
the radio-communication unit 20 employed in the portable- 
telephone device 301 through a path comprising the 
portable-telephone base station 231-1, the portable- 
telephone line network 232 and the portable-telephone 
base station 231-2. 
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The CPU 11 employed in the portable-telephone 
device 301 receives the IP address IP (202) at a step 
S503. At a step S504the CPU 11 supplies the IP address IP 
(202) to the command generating/analyzing unit 21 which 
then transmits the IP address IP (202) to the terminal 
adapter 302 through the infrared-ray generating unit 22. 

Us. 

p At a step S701, the infrared-ray receiving unit 4 0 

D 

ry employed in the terminal adapter 3 02 receives the IP 

m address IP (202) , passing a result of reception to the 

sfssi 

ry command generating/analyzing unit 3 8 which supplies the 

H IP address IP (202) to the CPU 31 through the interface 

fU unit 36. As a result, the terminal adapter 302 is 

S 

□ hereafter capable of transmitting an image signal to the 

terminal adapter 202, strictly speaking, to the received 
IP address IP (202), through the OCN 233. 

Then, processing is carried out among the portable- 
telephone device 301, the terminal adapter 302 and the 
authentication/accounting server 235 as the processing 
carried out among the portable-telephone device 201, the 
terminal adapter 202 and the authentication/accounting 
server 235 as described above. 

To put it in detail, if the user of the portable- 
telephone device 301 also wants to switch the 
communication mode from the ordinary telephone 
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conversation based only on audio signals to the so-called 
television-telephone conversation accompanied by 
transmission of images, the user operates the television- 
telephone button 16A of the portable-telephone device 301 
at a step S505. Since the portable-telephone device 301 
has the same configuration as the portable-telephone 
device 201 shown in Fig. 2, the operation of the 
portable-telephone device 301 is described referring to 
Fig. 2. At this time, the CPU 11 employed in the 
portable-telephone device 301 reads out a personal ID 
(PID) of the portable-telephone device 3 01 from the 
EE PROM 14, outputting the PID to the command 
generating/analyzing unit 21 along with a request for a 
television-telephone connection. The PID and the request 
for a television-telephone connection are then 
transmitted to the terminal adapter 302 from the 
infrared-ray generating unit 22 as an infrared-ray signal. 

When the infrared-ray receiving unit 4 0 employed in 
the terminal adapter 302 receives the infrared-ray signal 
transmitted by the portable-telephone device 301 at a 
step S702, a command conveyed by the signal is output to 
the command generating/analyzing unit 38. Since the 
terminal adapter 302 has the same configuration as the 
terminal adapter 202 shown in Fig. 3, the operation of 
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the terminal adapter 302 is explained properly referring 
to Fig. 3. The command generating/analyzing unit 38 
analyzes the command and supplies a result of the 
analysis to the CPU 31 through the interface unit 36. 
Receiving the PID and the request for a television- 
telephone connection transmitted by the portable- 
telephone device 301 at a step S703, the CPU 31 controls 
the communication unit 3 7 through the interface unit 3 6 
to make an access to the authentication/accounting server 
235 through the OCN 233 and the Internet 234. In the 
access, the PID of the portable-telephone device 301 and 
a terminal ID (TAID) of the terminal adapter 3 02 read out 
from the EE PROM 3 5 are transmitted to the 

authentication/accounting server 235 along with a request 
for authentication . 

At a step S403, the authentication/accounting 
server 235 receives the request for authentication, the 
PID and the TAID transmitted by the terminal adapter 3 02 
through the communication unit 89. The CPU 81 employed in 
the authentication/accounting server 235 judges whether 
or not the PID and the TAID are previously registered in 
the user control table of Fig. 6 stored in the hard disc 
88 as IDs which can be authenticated , that is, judged to 
be valid IDs. If the PID and the TAID are registered in 
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the user control table as valid IDs / the present time and 
date are cataloged in the user control table as a usage 
start time and date. At a step S404the CPU 81 of the 
authentication/accounting server 235 transmits a result 
of authentication from the communication unit 89 to the 
communication unit 3 7 of the terminal adapter 302 through 
the Internet 234 and the OCN 233. 

At a step S704 the CPU 31 of the terminal adapter 
302 evaluates the result of authentication received from 
the communication unit 37. If the result of 
authentication indicates that the PID and TAID required 
for carrying out a television-telephone communication are 
valid, the CPU 31 reads out an IP address IP (302) of the 
terminal adapter 302 stored in the EEPROM 35 in advance 
and controls the command generating/analyzing unit 38 to 
transmit the IP address IP (302) to the portable- 
telephone device 301 through the infrared-ray generating 
unit 39 as an infrared-ray signal at a step S705. 

At a step S506, the IP address IP (302) is received 
by the infrared-ray receiving unit 23 employed in the 
portable-telephone device 301 and passed the received 
signal to the CPU 11 by the command generating/analyzing 
unit 21 through the interface unit 15. 

If the result evaluated at the step S704 indicates 
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that authentication required for carrying out a 
television-telephone communication is not obtained , on 
the another hand, the IP address IP (302) of the terminal 
adapter 3 02 itself is not transmitted to the portable- 
telephone device 301 at the step S705. If the CPU 11 
employed in the portable-telephone device 3 01 does not 
receive the IP address from the terminal adapter 3 02 at 
the step S506, the CPU 11 judges that the television- 
telephone communication is not authenticated and 
therefore does not carry out subsequent processing for 
the television-telephone communication any more. 

If the CPU 11 receives the IP address IP (302) from 
the terminal adapter 302 at the step S506 as described 
above, on the another hand, the CPU 11 judges that the 
television-telephone communication is properly 
authenticated and therefore enters a television-telephone 
mode to carry out subsequent processing for the 
television- telephone communication. 

In this case, at a step S507, the CPU 11 employed 
in the portable-telephone device 301 controls the radio- 
communication unit 20 to transmit the IP address IP (302) 
of the terminal adapter 3 02 received at the step S506 to 
the radio-communication unit 2 0 employed in the portable- 
telephone device 2 01 through a path comprising the 
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portable-telephone base station 231-2, the portable- 
telephone line network 232 and the portable-telephone 
base station 231-1. 

The CPU 11 employed in the portable-telephone 
device 201 receives the IP address IP (302) at a step 
S106. At a step S107, the CPU 11 supplies the IP address 
IP (302) to the command generating/analyzing unit 21 
which then transmits the IP address IP (302) to the 
terminal adapter 2 02 by way of the infrared-ray 
generating unit 22. 

At a step S205, the infrared-ray receiving unit 40 
employed in the terminal adapter 202 receives the IP 
address IP (302), passing a result of reception to the 
command generating/analyzing unit 38 which supplies the 
IP address IP (302) to the CPU 31 through the interface 
unit 36. As a result, the terminal adapter 202 is 
hereafter capable of transmitting an image signal to the 
terminal adapter 302, strictly speaking, the received IP 
address IP (302), through the OCN 233. 

It should be noted that a request to switch the 
communication mode to a television-telephone conversation 
can be made from either the portable-telephone device 201 
or the portable-telephone device 301. 

Next, at a step S206, the CPU 31 employed in the 
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terminal adapter 202 controls the video-camera control 
unit 41 to supply image data picked up by the video 
camera 203 to the compression/decompression circuit 34 
then, the compression/decompression circuit 34 compresses 
the image data supplied thereto, supplying the compressed 
data to the communication unit 37. Subsequently, the 
communication unit 37 transmits the image data to the 
terminal adapter 302 through the OCN 233. 

At a step S7 06, the communication unit 3 7 employed 
in the terminal adapter 302 receives the image data, 
supplying the data to the compression/decompression 
circuit 34 then, the compression/decompression circuit 34 
decompresses the image data supplied thereto, feeding the 
decompressed data to the CPU 31. At a step S707, the CPU 
31 drives the 1394-interf ace unit 42 to transmit the 
image data decompressed by the compression/decompression 
circuit 34 to the television receiver 305 through the 
1394 bus 306. 

At a step S801, the 1394-interf ace unit 72 employed 
in the television receiver 305 receives the image data 
transmitted thereto through the 1394 bus 306, passing the 
data to the CPU 61. Then, the CPU 61 outputs the image 
data to the synthesizer 66 by way of the video-signal 
generating unit 68. Finally, the synthesizer 66 supplies 
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the image data to the display unit 67 for displaying the 
image thereon. The power supply of the terminal adapter 
302 and/or the television receiver 305 are forcibly 
turned on in case they are not turned on yet. As a result , 
an image of the user of the portable-telephone device 201 
is displayed on the display unit 67 employed in the 
television receiver 305. 

By the same token, at a step S708, the CPU 31 
employed in the terminal adapter 3 02 controls the video- 
camera control unit 41 to supply the image data of the 
user of the personal-telephone device 301 picked up by 
the video camera 3 03 to the compression/decompression 
circuit 3forthen, the compression/decompression circuit 
34 compresses the image data supplied thereto, supplying 
the compressed data to the communication unit 37. 
Subsequently, the communication unit 37 transmits the 
image data to the terminal adapter 202 through the OCN 
233 . 

At a step S207, the communication unit 37 employed 
in the terminal adapter 202 receives the image data, 
supplying the data to the compression/decompression 
circuit 34 then, the compression/decompression circuit 34 
decompresses the image data supplied thereto, supplying 
the decompressed data to the CPU 31. At a step S208, the 
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CPU 31 drives the 1394-interf ace unit 42 to transmit the 
image data decompressed by the compression/decompression 
circuit 34 to the television receiver 205 through the 
1394 bus 206. 

At a step S301, the 1394-interf ace unit 72 employed 
in the television receiver 205 receives the image data 
transmitted thereto through the 1394 bus 206, passing the 
data to the CPU 61. Then, the CPU 61 outputs the image 
data to the synthesizer 66 through the video-signal 
generating unit 68. Finally, the synthesizer 66 supplies 
the image data to the display unit # 67 for displaying the 
image thereon. As a result, an image of the user of the 
portable-telephone device 3 01 is displayed on the display 
unit 67 employed in the television receiver 205. 

In this way, the users of the portable-telephone 
devices 201 and 301 are capable of having a telephone 
conversation thereafter while looking at the images of 
their partners . 

As the telephone conversation is completed at a 
step S108, typically, the user of the portable-telephone 
device 201 operates the television-telephone button 16A 
of the input unit 16 employed in the portable-telephone 
device 201. At this time, the CPU 11 controls the radio- 
communication unit 2 0 to transmit a termination-request 
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signal to the portable-telephone base station 231-1. 
Receiving the termination-request signal , the portable- 
telephone base station 231-1 cuts off the communication 
line and, at the same time, transmits the signal to the 
portable-telephone device 301 through the portable- 
telephone line network 232 and the portable-telephone 
base station 231-2, Notified of the termination at a step 
S508, the user of the portable-telephone device 301 ends 
the telephone conversation with the user of the portable- 
telephone device 201. Then, at a step S509, the user of 
the portable-telephone device 3 01 operates the 
television-telephone button 16A of the input unit 16 
employed in the portable-telephone device 3 01 to make a 
request for termination of the telephone conversation. At 
that time, the CPU 11 employed in the portable-telephone 
device 301 controls the command generating/analyzing unit 
21 for driving the infrared-ray generating unit 2 2 to 
transmit the termination-request signal to the terminal 
adapter 302. 

At a step S709, the infrared-ray receiving unit 40 
employed in the terminal adapter 302 transfers the 
received termination-request signal to the command 
generating/analyzing unit 38 which then passes the signal 
to the CPU 31. The CPU 31 finally carries out the 
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processing to terminate the television-telephone 
communication in accordance with the termination-request 
signal. 

When the user of the portable-telephone device 301 
operates the television-telephone button 16A at the step 
S509 as described above, the communication line between 
the terminal adapters 202 and 302 is released. 

When the user of the portable-telephone device 201 
operates the television-telephone button 16A of the input 
unit 16 employed in the portable-telephone device 201 to 
make a request for termination of the telephone 
conversation at the step S108 as described above, the CPU 
11 employed in the portable-telephone device 201 controls 
the command generating/analyzing unit 21 for driving the 
infrared-ray generating unit 22 to transmit a 
termination-request signal to the terminal adapter 202 at 
a step S109. Then, at a step S209, the infrared-ray 
receiving unit 40 employed in the terminal adapter 202 
transfers the received termination-request signal to the 
command generating/analyzing unit 38 which then passes 
the signal to the CPU 31. The CPU 31 finally carries out 
processing to terminate the television-telephone 
communication in accordance with the termination-request 
signal. 
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Then, at a step S210, the CPU 31 employed in the 
terminal adapter 202 transmits the PID of the portable- 
telephone device 201 , the TAID of the terminal adapter 
202 and a notice of the television-telephone termination 
to the authentication/accounting server 235 from the 
communication unit 37 through the OCN 233 and the 
Internet 234. At a step S405, the PID, the TAID and the 
termination notice are received by the communication unit 
89 of the authentication/accounting server 235 which 
passes the signals to the CPU 81. Receiving the 
information, the CPU 81 carries out: processing to 
terminate the television telephone. Then, the present 
time and date are registered in the user control table 
shown in Fig. 6 as a usage end time and date on the user 
control table and, at the same time, a television- 
telephone charge for the period of time between the usage 
start time and the usage end time is computed and 
registered in a column for a cumulated charge of using 
the television-telephone set. Later, the CPU 81 carries 
out processing to draw money indicated by the computed 
charge from a credit card, the number of which is 
registered in the user control table on the same line as 
the PID. 

As described above, a request for termination of 
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the telephone conversation is made from the portable- 
telephone device 201. It should be noted/ however, that 
such a request can also be made from the portable- 
telephone device 301/ the partner of the portable- 
telephone device 201 initiating the telephone 
conversation. In addition/ in the case of a change 
request from the portable-telephone device 201 to the 
portable- telephone device 301 f made from the called 
portable-telephone device 301/ the charge of the 
television-telephone communication can also be billed to 
the portable-telephone device 301. 

As described above/ the user of the portable- 
telephone device 2 01 is capable of having a telephone 
conversation like a television-telephone conversation 
with the user of the portable-telephone device 301 when 
necessary by operating the television-telephone button 
16A in the course of an ordinary telephone conversation 
based on audio signals. 

In order to make the portable-telephone device 201 
portable, the portable-telephone device 201 is designed 
to have a small size. Thus, by moving with the portable- 
telephone device 201 to a predetermined place where the 
terminal adapter 202 is installed/ the user can have a 
television-telephone conversation with a partner. Assume 
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that the user has a television-telephone conversation by 
using the portable- telephone device 201 in a room where a 
terminal adapter 202-1 and a television receiver 205-1 
connected to each another by a 1394 bus 206-1 are 
installed, and moves taking along with the portable 
telephone device 201 to another room where another 
terminal adapter 202-2 and another television receiver 
205-2 connected to each another by another 1394 bus 206-2 
are installed as shown in Fig. 8. When moving from the 
former room to the latter room, the user turns off the 
television-telephone button 16A to temporarily suspend 
the television-telephone conversation, continuing a 
telephone conversation based on audio signals as it is. 
In the latter room, the user can resume the television- 
telephone conversation by again operating the television- 
telephone button 16A. 

Television receivers have spread as evidenced by 
the fact that a plurality of sets are installed per home 
these days. In addition, a terminal adapter having a 
simple configuration can be connected to each television 
receiver relatively with ease. That is to say, by adding 
some functions to the already existing infrastructure, a 
television-telephone communication can be established at 
any desired location close to a television receiver. 
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As described above, a television-telephone 
conversation suspended at a location can be resumed at 
another place not only in the same building as the 
location but also in a different building. 

As described above , the terminal adapters 2 02 and 
302 are connected to the television receivers 205 and 305 
respectively. It is worth noting, however, that the 
terminal adapter 202 and the television receiver 205 can 
be replaced by a personal computer 301 as shown in Fig. 9. 
By the same token, the terminal adapter 302 and the 
television receiver 305 can be replaced by a personal 
computer 331. In this case, the personal computer 301 
comprises a main body 311, a display unit 312, a keyboard 
313 and a mouse 314 the main body 311 is connected to a 
video camera 203 and an infrared-ray communication unit 
204. By the same token, the personal computer 331 
comprises a main body 341, a display unit 342, a keyboard 
343 and a mouse 344 the main body 341 is connected to a 
video camera 303 and an infrared-ray communication unit 
304. 

The personal computer 301 which is also used for 
television-telephone communication typically has a 
configuration like one shown in Fig. 10. Since the 
personal computer 331 has the same configuration as the 
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personal computer 301 , the personal computer 331 is not 
shown in a figure. 

In the typical configuration shown in Fig. 10, a 
CPU 131 carries out various kinds of processing by 
execution of programs stored in a ROM 132. A RAM 133 is 
used for properly storing data and programs required by 
the CPU 131 in carrying out the processing. The keyboard 
313 and the mouse 314 are operated by the user for 
entering a variety of commands to be supplied to the CPU 
131 by way of the interface unit 134. On the display unit 
312, characters and images are properly displayed. A hard 
disc 135 is used for storing the ID of the personal 
computer 301. A communication unit 136 carries out 
communication with the OCN 233. A video-camera control 
unit 137 controls the video camera 203 to take an image 
of the user and outputs the image to a 

compression/decompression circuit 138 for compressing 
image data picked up by the video camera 2 03 and 
decompressing image data supplied thereto by the 
communication unit 136. A speaker 139 outputs an audio 
signal whereas a microphone 140 picks up an audio signal. 
An interface unit 134 serves as an interface between the 
CPU 131 and components; the display unit 312, the 
keyboard 313, the mouse 314, the hard disc 135, the 
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communication unit 136, the video-camera control unit 137, 
the compression/decompression circuit 13 8, the speaker 
139 the microphone 140 and the infrared-ray communication 
unit 204. 

The portable-telephone line network 232 described 
above is a network of the so-called connection-type 
communication lines in which the two users of the 
portable-telephone devices 201 and 301 occupy one 
telephone line. On the another hand, the OCN 233 
comprises the so-called connectionless-type communication 
lines used by a number of users at 'the same time instead 
of being occupied by the two users of the portable- 
telephone devices 201 and 301. That is to say, in the 
communication system shown in Fig. 1, connection-type 
communication lines of the portable-telephone line 
network 232 are used for communicating IP addresses as 
access information required for communicating image data 
as main information. The image data itself is 
communicated by using connectionless-type communication 
lines of the OCN 233. 

In a communication system like one shown in Fig. 11, 
on the another hand, typically , image data is 
communicated between the terminal adapters 202 and 203 
through the OCN 233 initially. With such a communication 
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of image data established, telephone numbers of 
communication partners, that is, the portable-telephone 
devices 201 and 301, can be communicated through the OCN 
233 whereas audio data serving as main information is 
communicated by way of the portable-telephone line 
network 232 • In this case, the television-telephone 
button 16A of the input unit 16 employed in the portable 
telephone device 201 shown in Fig. 2 is provided on the 
input unit 43 of the terminal adapter 202. 

Assume that a television-telephone conversation 
becomes necessary during the communication based on audio 
signals through the Internet 234 between Internet phones 
251 and 252 in a communication system shown in Fig. 12. 
In this case, the IP addresses of the terminal adapters 
202 and 302 can be communicated through the Internet 234 
between the Internet phones 251 and 252 and, when the IP 
addresses are received, image data can be exchanged as 
main information through the OCN 233 between the terminal 
adapters 202 and 302. In such communication, IP addresses 
and image data are both communicated by using 
connectionless-type communication lines as access 
information and main information respectively. 

In a communication system shown in Fig. 13, image 
data is exchanged between the terminal adapters 202 and 
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302 by using a public telephone-line network 236. In this 
case, the telephone numbers of the terminal adapters 202 
and 3 02 can be communicated between the portable- 
telephone devices 201 and 301 through the portable- 
telephone line network 232 and, by using the telephone 
numbers, image data can be communicated between the 
terminal adapters 202 and 302 as main information. In 
such a communication system, the telephone numbers and 
image data are both communicated by using connection-type 

communication lines as access information and main 

» 

information respectively. 

In a communication system shown in Fig. 14, image 
data is communicated as main information through a 
communication network 241 called AMInet only in this 
specification. The AMInet comprises connection-type 
communication lines. In this case, the required access 
information is IP addresses instead of telephone numbers. 
Between portable-telephone devices 201 and 301 in such a 
communication system, IP addresses are communicated 
through the portable-telephone line network 232 whereas 
resource-reservation information of an ASP (AMInet Set-up 
Protocol) is communicated through the AMInet 241. After 
these communications, image data is communicated as main 
information between the terminal adapters 202 and 302. 
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The ASP is a resource reservation protocol in the AMInet. 
In this communication system, communication lines are 
connection-type communication lines. 

The AMInet is a network having a large transmission 
capacity and a high transmission speed over a large range 
wherein a reservation for preserving a band can be made 
and a QOS (Quality of Service) is assured. In this 
example, such features can be implemented. For details, 
refer to Japanese Patent Application No. Hei9-279826 of 
the assignee of the present invention and corresponding 
to US Patent Application Serial No.* 08/160472 field on 
September 24, 1998 or a reference authored by Atsushi 
Shionozaki, Yasutaka Miwa and Fumio Teraoka with a title 
of "Implementation of Real-Time Communication by 
Integration of ATMs and IPs in the AMInet" submitted as 
part of a collection of theses presented to the forteenth 
conference of the Japan Software Academic Society, the 
September and October numbers, 1997. 

It should be noted that, as a PID described above, 
a caller ID can be used. A caller_ID is the telephone 
number of the call originator which is used in a service 
of displaying the telephone number of the call originator 
or information prior to communication. In this case, 
caller_ids stored in the EEPROMs 14 of the portable- 
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telephone devices 201 and 301 are used in place of the 
personal IDs described above. In addition , a portable- 
telephone device of any type can be used. 

As described above, video or audio data is used as 
main information of communication. It should be noted 
that the present invention can also be applied to a case 
in which another data is communicated as main information. 
In addition, the present invention can also be applied to 
a case in which a simplex communication line is used as a 
communication line for transmitting main information. 

As described above, according to the embodiment of 
the present invention, by merely adding a minimum 
facility to a communication apparatus such as a portable 
telephone device for use by the user to have a 
traditional telephone conversation based on voice, an 
extended function of a television-telephone set for use 
by the user to have a television-telephone conversation 
by looking at an image of the partner can be implemented 
in a simple and low-cost configuration. As a result, the 
user is capable of using the function of a television- 
telephone set at any place by visiting for example any of 
stores selling home electrical appliances at which a 
large number of television receivers and VTRs of the 
integrated-camera type are displayed. It is thus possible 

47 




to implement the so-called ubiquitous communicator. In 
addition , if such appliances are displayed in a store 
also as resources of society , they can also be put into 
effective use. 

Furthermore, since it is not necessary to provide 
the communication apparatus itself such as a portable 

telephone device with components such as a CCD camera, a 

O 

ry liquid crystal display device and an image 

SJ 

m compressing/decompressing circuit, it is possible to 

y avoid factors serving as a hindrance to portability such 

Mi as increases in apparatus size and weight. 

ry 

iU It should be noted that presentation media for 

O presenting a computer program to be executed for carrying 

out the processing described above include communication 
media such as a network and a satellite in addition to 
recording media like a magnetic disc, a CD-ROM and a 
solid-state memory. 
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